AD-A233  506 


FTD-ID(RS)T-0709-90 


» 


i 


FOREIGN  TECHNOLOGY  DIVISION 


\ 


NEW  IMAGE-TRACKING  ALGORITHM  FOR  FUZZY- 
RELAXATION  MATCHING  OF  POINT  PATTERNS 


by 


Zhili  Liu,  Yihe  Yang,  Weizhen  Zhou 


t 


I 


Approved  for  public  release; 
Distribution  unlimited. 


FTD-  ID(RS)T-0709-90 


HUMAN  TRANSLATION 


FTD-ID(RS)T-0709-90  29  October  1990 

MICROFICHE  NR:  HD- 90-C- 000997 

NEW  IMAGE-TRACKING  ALGORITHM  FOR  FUZZY - 
RELAXATION  MATCHING  OF  POINT  PATTERNS 

By:  Zhili  Liu,  Yihe  Yang,  Weizhen  Zhou 

English  pages:  12 

Source:  Hongwai  Yanjiu,  Vol.  8,  Nr.  5,  1989, 
pp.  349-354 

Country  of  origin:  China 
Translated  bv:  Leo  Kanner  Associates 
F33657-88-D-2188 

Requester:  FTD/TTX/Sandra  Hiltenbeitel 

Approved  for  public  release;  Distribution  un]imited. 


THIS  TRANSLATION  IS  A  RENDITION  OF  THE  ORIGI¬ 
NAL  FOREIGN  TEXT  WITHOUT  ANY  ANALYTICAL  OR 

PREPARED  BY. 

EDITORIAL  COMMENT.  STATEMENTS  OR  THEORIES 
ADVOCATED  OR  IMPLIEC  ARE  THOSE  OF  THE  SOURCE 

TRANSLATION  DIVISION 

AND  DO  NOT  NECESSARILY  REFLECT  THE  POSITION 

FOREIGN  TECHNOLOGY  DIVISION 

OR  OPINION  OF  THE  FOREIGN  TECHNOLOGY  DIVISION 

’  WPAFB.  OHIO 

1990 


'-ID(RS)T-0709-90 


Date  29  October 


GRAPHICS  DISCLAIMER 


All  figures,  graphics,  tables,  equations,  etc.  merged  into  this 
translation  were  extracted  from  the  best  quality  copy  available. 


i 

» 

i 

i 


Distribution/ 


Availability  Cod 03 


Dial 


[Avail  asct/or 
Special 


NEW  IMAGE-TRACKING  ALGORITHM  FOR  FUZZY-RELAXATION 
MATCHING  OF  POINT  PATTERNS 


Liu  Zhili,  North  China  Research  Institute  of  Electro-Optics, 
Beijing,  and  Yang  Yihe  and  Zhou  Wei zhon,  Department  of  Technical 
Physics,  Xi'an  University  of  Electronics  Science  and  Technology 

Abstract 

The  paper  presents  a  new  image-tracking  algorithm  for  fuzzy- 
relaxation  matching  of  point-patterns.  The  algorithm  is 
insensitive  to  geometric  distortions  of  the  whole,  to  inaffine 
distortions  to  a  certain  extent,  and  to  multi-  and  few-point 
distortions.  The  presentation  of  the  new  matching-vector  set  and 
the  standard  set  greatly  reduces  computation  time.  As  shown  by 
simulation  results  of  multi-target  infrared  image  array  in  the 
sea,  the  algorithm  is  adaptable  not  only  to  a  single  target,  but 
also  to  multiple  targets  in  acquisition,  locating,  and  tracking. 

Key  words:  image  tracking,  graphic  matching,  and  graphic 
recalibration . 

/ .  Introduction 

During  the  initial  stage  of  guidance  by  a  tracker,  since  the 
target  is  relatively  far  away,  the  target  image  is  relatively 
small;  there  are  many  targets  in  the  visual  field,  in  addition  to 
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considerable  interference  in  the  background,  mass-center  trackers 
and  the  correlation  trackers  are  not  suitable.  During  a  flight 
process,  the  visual  angle  continually  varies;  in  addition,  there 
is  a  certain  degree  of  geometric  distortions  (rotation, 
amplification  and  translational  motion)  existing  between  frames, 
so  perspective  distortions  and  local  inaffine  distortions  are 
present.  Possibly,  the  interframe  point  patterns  are  not 
identical . 

By  using  the  matching  alggrithm,  the  authors  solved  the 
problem  of  image  distortions  confronted  during  the  initial 
guidance  stage.  In  addition,  the  authors  selected  point-pattern 
type  point  sets,  constituting  mass  centers  in  the  target  zone. 
With  the  other  geometric  characteristics  or  physical 
characteristics  as  supplements,  the  point-pattern  type  interpoint 
space  structure  relation  is  utilized  to  conduct  point-pattern 
type  matching  tracking,  thus  basically  solving  the  problems  of 
geometric  distortions,  perspective  distortions,  local  inaffine 
distortions,  and  multi-  and  few-point  situations  of  interframe 
point-pattern  type. 

The  algorithm  can  be  used  to  intercept  the  target  visual 
field  from  the  target  launching  as  well  as  to  observe  the  servo- 
motions  in  the  visual  field,  thus  eliminating  the  transient 
violent  disturbances  during  launching  and  to  conduct  locating  and 
tracking  of  the  attacking  target. 

Matching  Algorithm  for  Fuzzy-Relaxation  Matching  of 
Point  Patterns 

Select  the  ratio  between  the  square  of  the  circumference 
length  and  area  in  the  target  as  the  supplementary 
characteristic,  which  has  the  constant  features  of  rotation, 
amplification,  and  translational  motion.  The  mass  centers  in  the 
target  zone  constitute  a  point-pattern  type;  by  introducing  the 
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concept  of  standard  vector,  the  computation  speed  is  increased. 

By  introducing  the  vector  space  and  utilizing  the  mean-variance 
minimum  criterion,  we  can  derive  the  function  in  describing 
space-structure  relation  similarity  of  the  vector.  Then  by  using 
the  supplementary  vectors,  the  iterative  process  of  fuzzy- 
relaxation  matching  is  conducted  until  the  iterative  process 
approaches  a  steady  state. 

The  mathematical  model  of  point-pattern  type:  by  using  the 
mass  centers  in  the  target  zone  as  coordinates  (X,  Y)  in  the 
target  zone,  different  concrete  problems  select  different 
supplementary  characteristics.  After  a  large  number  of 
experiments,  the  authors  selected  P2/A  as  the  supplementary 
characteristic;  refer  to  [1]  for  the  selection  of  supplementary 
characteristics;  refer  to  [2]  for  the  method  of  computing 
characteristic  values. 

M  and  W  represent,  respectively,  the  reference  point-pattern 
type  and  the  real-time  point-pattern  type.  There  is  a  total  of  m 
points  in  M;  and  there  is  a  total  of  n  points  in  W. 

if Y,„  F*)}, 

2.1.  Vector  Sets  in  Fuzzy-Relaxation  Matching 

(1)  Prefiltered  wave 

By  utilizing  a  simple  characteristic  value  and  the  threshold 
value  method,  very  dissimilar  points  are  eliminated.  First, 
solve  for  the  additional  limitation  F0  of  the  maximum  value  Fmax 
and  the  minimum  value  Fm^n  of  P((i m)  characteristic  value 

Fpi  in  M.  Then  all  characteristic  values  Fgj  are  compared  to  the 
threshold  values  of  Q/0'=i,  «)  in  W,  if  F9)< Fmia~F,  or 

F'^Ftui+F,,  ,  remove  Qj  point  in  W;  otherwise,  retain 

the  Qj  point. 
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(2)  Obtaining  vector  in  M 


In  order  to  reduce  the  possible  number  of  matching  vectors, 
the  attacking  target  (t)  can  be  selected  as  the  vector  starting 
point,  and  other  points  (u)  in  M  as  the  endpoint,  thus 
constituting  a  vector  set  as  shown  in  Fig.  1.  Pfu  is  the 
concentrated  vector  in  In  order  to  further  reduce  the 

computational  volume,  the  authors  introduce  the  concept  of 
standard  vector.  The  key  to  establishing  the  standard  vector  is 
based  on  selecting  the  endpoint  B?  refer  to  the  two  following 
statements  for  the  selection  principle:  (i)  the  characteristics 
of  point  B  are  more  apparent  than  those  of  other  points  (other 
than  T)  in  M;  and  (ii)  point  B  certainly  exists  in  W;  it  is 
neither  too  close  nor  too  far  between  point  B  and  point  T,  such 

aS  IPTSlMEDIANilPtfil}. 


( 3 )  Obtaining  vector  set  in  the  point  set  W 

Any  two  points  in  W  can  constitute  a  vector.  In  order  to 
reduce  the  number  of  possible  vectors,  a  criterion  is  introduced. 
Let  P|  be  the  starting  point  in  0M  and  let  be  the  endpoint, 
thus  constituting  vector  .  In  0M,  Qj  is  the  starting  point, 
and  Qi  is  the  endpoint,  thus  constituting  a  vector  Qj-t  .  Let  us 
introduce  the  function 

Om(P&,  f1) 

Select  threshold  value  1,  if  Ol0)(Pa,  Q$)>1  ,  then 

determine  the  vector  in  QM,  otherwise  reject  it.  Refer  to  Fig.  2 
for  the  set. 
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2.2.  Tracking  algorithm  for  fuzzy-relaxation  matching 
(1)  Similarity  function  0$),  (P*£,  Qrrr)} 

When  one  compares  the  degree  of  similarity  of  space 
structures  of  Pi i  and  Qj  vectors,  let  us  introduce 

P~€Q*(P^+Pa)  and  Qtz€£>w  (0*1+0$)  as  the  supplementary 

vector  pair.  With  <?{•}  we  describe  the  degree  of  similarity  of 
space  structure  relations  of  vector  pair  (pa>  p ~).  in  and 

vector  pair  ( Q Qffi  infiw. 

Assume 

P-{Pt>  P>,  P„  P.)-{P3,  Pi,  Pi,  P<}-{P,} 

Q“{Q/>  Oi,  Ot,  i,  Qt,  Ot,  0*}  —  {Q/} 

The  coordinates  Pj  and  Qj  are  expressed  as  complex  numbers 
P^X9j+iY,A  Q,-X',+iY't 

describes  the  rotation  and  amplification 

quantities; 

W^Wt+iW,  describes  the  translational  motion. 
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After  linear  transformation  $(Z,  W) 


into  ^  , 


§1“  ZQj+W , 


,  Qj  is  converted 


Let 

X*.  XH), 

JWr„,  r„,  r*.  r*), 

x„,  x,t)  x„),  ‘ 

1%-ov,  r,„  3V,  r*), 

17 -(1,  1,  1,  1); 

Then  £<l-z1>X"-z%-Y'l+wls 

-2V+ WV  ■ 

Let  us  use  the  distance  and  the  minimum  between  the 
corresponding  starting  point  and  the  corresponding  endpoint  of 
the  matching  vector  and  the  supplementary ' matching  vector  as  the 
criterion. 


AfJA7  jsiP  /— } 

#(*.*:  u-i  J 

~it.{(X,I-Z,.Xqi+ZrYtl-Wiy+(Y,l-Zi-Y'l-ZrXil-Wi)'}i 


Let  e2  =  0,  the  above  equation  can  be  rewritten  in  matrix 

form 


Tji.+y.T,  o 

x^u 

i 

\ZA 

0 

XTQX,+YIY' 

-Y\U 

~Y\'U 

u 

x,u 

-Y,U 

4 

0 

IH’i 

y,u 

X,-E7 

0 

4  . 

xix,+y;-Y'- 

YT'X'-Xl-Y, 

X\U 

Y\TJ 
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Thus  we  derive 

2,  =  [4  X'+iY'-Y,- (Xl-V)  •  (Xl-U)  -  (YIU)  •  (rjT7)] /«. 

Zs-  [4 r  J.  Xa-4  A'rp.Fe-f  (r;?7) •  (X-£7)  -  (Xr,U)  •  (FJt7)]  'a5 
[(XT,X,+YIY')-(XTU)  -  (X :i'X,+Yl-YQ)(XlU) 

+  (YT-Xg-XlYq)'(YT-U)]  a; 

Ws=i(XTXq+YlYq)‘(Yl'U)-(Xl.Xq  +  Yl-Y9)(YlV) 
~(Y^Xq-X^Yq)(X^V)]/a., 

a«4xj.x,-r4y;.Fc-(x;.u)8-(yj.u)». 

The  greater  the  similarity  between  the  space  structure 
relation  of  vector  pair  (Pa,  Par)  in  {2jj  and  the  space  structure 
relation  of  vector  pair  CQji.  Qtf).  in  12w,  the  smaller  the  value 
of  e2,  the  greater  the  value  of  (?{*)  .  The  (?{•}  equation  is 

ff{(Pa,  Qji).  (P->  Qj?)}  ■»l/(l+o-«8),  ^ 

=  const,  0<G{*}<1. 

(2)  Iterative  matching  process  of  fuzzy  relaxation. 

Mainly,  the  space  structure  relation  is  adopted  in  the 
fuzzy-relaxation  matching  algorithm?  the  assigned  classification 
uses  the  characteristic  value  as  a  supplement?  the  degree  of 
assigning  is  expressed  by  the  degree  of  subordination.  By 
utilizing  the  space  structure  similarity  function,  (?{•}  ,  gradual 
revisions  are  made  of  the  degree  of  classification  subordination 
until  a  relatively  stable  degree  of  subordination  is  reached.  By 
matching  12^  and  £2^,  actually  this  is  based  on  a  comparison  of 
degrees  of  similarity  of  various  vectors  in  Qw  by  a  certain 
vector  in  12M  to  arrive  at  a  subordination  classification.  For  a 
certain  vector  P/*  in  when  determining  the  degree  of 
subordination  of  vectors  Qj[  in  Pa  and  flw,  consideration  is 
given  to  seeking  a  vector  <2r*(Qil*Q Ji)  in  0^  for  each  vector 
to  each  vector  Par  (.Par  ^  Pin)  in  £2^'  so  that  the  space 
structure  relation  between  Qtx  and  Qy,  and  the  space  structure 
relation  between  Par  and  Pi i  is  the  most  similar. 
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6""'(P/i,  Qj  describes  the  fact  that  the  degree  of 
subordination  of  P<*  subordinating  to  Qjj  in  an  n-th  iterative 
process.  The  contribution  made  by  each  supplementary  vector  pair 
(P,— ,  Qn)  to  0^(Prk,  Qjj)  is  made  up  of  two  parts: 

(i)  Oln~l)(P;zt  Q?0)  describes  the  degree  of  subordination  of 

Psr  subordinating  to  Q77  in  the  (n  -  l)-th  iterative  process; 

(ii)  the  space  structure  similarity  function 

(?{(?;*.  (P«T» 

If  Pft  and  Qji  are  matching  vectors,  then  both  are 
relatively  large?  otherwise,  at  least  one  of  the  two  is 
relatively  smaller.  We  adopt  a  cautious  principle 

MiN{G[(prk,  Qr,),  (Ptz,  Qr,)], 

o^CPnr,  Qr,)} 

After  picking  P~£Q v  as  the  supplementary  vector, 

different  Q,-t,€£ir  make  different  contributions  to  ;  the 

largest  contribution  is 

MAX{MJN[G((Prk,  Qji), 

Qtl+Qji 

(P.v,  Q«r)),  o("-1)(P.t,  Qi?)]>. 

If  P/i  and  Qj}  are  matching  vectors,  then  there  should  be 
the  corresponding  matching  supplementary  vectors  and  (for  , 

then  the  above  equation  yields  larger  values. 

If  there  is  a  match  between  Pfi  and  Qji  ,  then  all  P«  can 
find  the  corresponding  Qrt  vector  in  so  that  the  space 
structure  relation  constituted  by  Q,z  and  Qji  is  similar  to  the 
space  structure  relation  constituted  by  Pjj*  and  P»i  .  Based  on 
the  principle  of  caution,  Ow(Pft,  Qfi)  cannot  be  larger  than 

the  minimum  value  in  the  above-mentioned  equation  of  all  the 
derived  Pj^S^k  supplementary  vectors.  Therefore,  the 
iterative  process  of  fuzzy-relaxation  matching  can  be  written  as 
follows: 
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o«(Pa,  Qa) -if IN  {MAX{  MJN  m(Pa,  Qz),  (Psr,  Qa)] , 

*a «efi»  9R«0» 

(  3  ) 

o(-1}(Psr,  Qtv)J}}. 

The  initial  value  of  the  iterative  process  is  determined  by 
the  characteristic  value.  From  Eq.  (1),  after  several  times 
(generally  two  times  is  enough)  of  iterative  substitution,  all 
O^KPii,  Oh)  values  approach  a  steady-state.  For  Qfi  vectors 

corresponding  to  a  Pa  vector,  the  maximum  Qji  of  0^>(prh 
value  selected  as  the  matching  vector  of  Pa  .  The  corresponding 
pair  of  starting  points  and  the  pair  of  endpoints  of  the  matching 
vector  are  the  corresponding  matching  points  in  M  and 
Actually,  this  is  enough  to  satisfy 

|0<">(Pa,  Qji)  -O^KPa,  Qji)  I  <P 


(3)  Obtaining  tracking  signals 

After  the  tracking  algorithm  of  fuzzy-relaxation  matching  is 
applied,  we  obtain  the  signals  of  attacking  target  T  (or  multiple 
targets)  and  tracking  (rotation,  amplification,  and  translational 
motion  parameters  between  the  real-time  point-pattern  type  and 
the  reference  point-pattern  type).  In  these  parameters,  the 
rotation  angle  0  is  0=arctan(Zs/£j)  ;  amplification  times 

S  is  S^^zi-.-Zt  ;  and  translational  motion  (b,  K)  is 

n  =  Wx;  K  =  W2. 

2.3.  Analysis  of  real-time  features 

Fig.  3  is  a  figure  for  analysis  of  real-time 
characteristics.  As  shown  by  a  detailed  analysis,  if  the  number 
of  iterative  substitutions  is  r,  there  are  m  vectors  in  and 
there  are  n  vectors  in  each  computation  time  is  0.1  /xs,  then 
the  total  computation  time  t  required  is 

t  =  37. 2 (m  -  l)(n  -  l)*r;  assume  m=5,  n=8,  r=4,  then  the 
computation  time  (4.2  ms)  is  less  than  20  ms;  therefore,  this  is 
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real  time.  In  actual  computation,  time  is  hardware  design- 
dependent  . 


Fig.  3.  Illustration  for  real-time  analysis 
KEY:  *  iterative  substitution 

III.  Target  Simulation  Experiments  in  the  Sea 

The  authors  conducted  simulation  experiments  (refer  to 
Fig.  4  (a,  b,  c)  by  utilizing  a  multi-target  infrared  image  array 
in  and  on  the  sea.  In  Fig.  4  (a)  and  Fig.  4  (b),  there  are  four 
targets:  A,  B,  C,  and  D.  Fig.  4  (c)  is  obtained  from  Fig.  4  (a) 
by  artificially  eliminating  target  D  and  simultaneously  adding 
targets  E,  F,  and  G  (a  total  of  six  targets).  There  are 
geometric  distortions  as  a  whole,  inaf fine-geometric  distortions, 
and  perspective  distortions  exist  between  Fig.  4  (a)  and  Fig.  4 
(b) .  In  addition  to  the  above-mentioned  distortions  between  Fig. 
4  (c)  and  Fig.  4  (a),  and  between  Fig.  4  (c)  and  Fig.  4  (b) , 
there  are  multi-  and  few-point  distortions. 
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